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FOREWORD 


This  study  tested  the  effectiveness  of  PC-based 
aviation  training  devices  (PCATDs)  in  instrument 
training  for  the  purpose  of  guiding  regulation  and 
certification  considerations  by  the  Federal  Aviation 
Administration  (FAA).  Heretofore,  only  data  of  a 
subjective  nature  had  been  available. 

The  study  was  supported  under  FAA  Grant  No. 
94-G-044  with  the  University  of  Illinois  at  Urbana- 
Champaign  during  fiscal  years  1995  and  1996.  Ms. 
Karen  Ayers,  Ms.  Diana  Christenson,  andMs.  Sharon 
Allen  assisted  with  the  manuscript  and  Mr.  Greg 
Morrison  provided  technical  assistance  during  equip¬ 
ment  set-up;  Mr.  Ricky  Weinberg,  chief  pilot,  and 
Mr.  Richard  Keir,  instrument  course  supervisor,  pro¬ 
vided  invaluable  assistance  with  flight  operations  and 
with  student  management.  Mr.  Steve  Owen,  Mr. 


David  Petersen,  and  Mr.  Phillip  Martin  served  as 
stage  check  pilots  for  the  study.  We  thank  the  flight 
instructors  and  the  students  of  Aviation  130  and 
Aviation  140  for  participating  in  the  study. 

Sponsorship  of  the  study  was  provided  by  Mr. 
Thomas  C.  Accardi,  Director,  Flight  Standards  Ser¬ 
vice,  AFS-1 .  Project  oversight  was  provided  by  Mr. 
Louis  C.  Cusimano,  AFS-800,  and  Mr.  Lauren 
Basham,  AFS-840.  Human  factors  program  coordi¬ 
nation  was  provided  by  Dr.  Thomas  McCloy  and 
Mr.  Ronald  Simmons,  Office  of  the  Chief  Scientist 
and  Technical  Advisor  for  Human  Factors,  AAR- 
100.  Drs.  Robert  E.  Blanchard  and  Kevin  W. 
Williams  served  jointly  in  the  role  of  contracting 
officer’s  technical  representative  for  FAA  Civil 
Aeromedical  Institute. 
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Transfer  of  Training  Effectiveness  of  Personal 
Computer-Based  Aviation  Training  Devices 


INTRODUCTION 

The  resources  required  for  flight  training  impose  a 
substantial  burden  on  the  aviation  community.  The 
potential  to  reduce  costs  through  the  use  of  inexpen¬ 
sive  but  effective  training  devices  has  added  an  incen¬ 
tive  for  flight  training  departments  to  conduct  more 
training  with  ground-based  flight  training  devices. 
The  cost  of  currently  certified,  generic  flight  training 
devices  is  out  of  reach  of  many  flight  students  and 
flight  schools,  but  personal  computer-based  aviation 
training  devices  (PCATDs)  offer  a  low-cost  alterna¬ 
tive  for  instruction  of  flight  tasks.  Recently,  there  has 
been  increased  demand  from  developers,  from  indus¬ 
try,  and  from  training  organizations  to  use  PCATDs 
in  flight  training.  A  summary  of  a  joint  industry- 
Federal  Aviation  Administration  (FAA)  conference 
concerned  with  the  development  and  use  of  PCATDs 
documents  this  emphasis  (Williams,  1994).  An  expense 
of  less  than  $10,000  will  provide  a  PCATD  including 
software,  computer  hardware,  and  a  flight-control  sys¬ 
tem.  This  is  within  reach  of  most  flight  schools. 

PCATDs  have  generated  considerable  enthusiasm 
within  the  aviation  industry  (Falun,  1992;  Lert,  1990; 
Peterson,  1993).  Hampton,  Moroney,  Kirton,  and 
Biers  ( 1 994)  reported  that  students  trained  in  a  PCATD 
performed  as  well  on  instrument  procedures  in  the 
airplane  as  those  students  trained  in  a  Frasca  141. 
Nevertheless,  there  is  no  clear  evidence  that  PCATD 
training  will  transfer  effectively  to  an  airplane  across 
a  broad  range  of  flight  tasks.  The  fidelity  of  PCATDs 
is  low  in  areas  normally  thought  to  be  important: 
representation  of  displays,  switches,  and  out-of-cock¬ 
pit  scenes;  with  control  loading  and  flight  dynamics 
being  the  most  obvious.  In  addition,  PCATDs  accept 
control  inputs  from  low-fidelity  devices  that  range 
from  computer  keyboards,  single  joysticks,  and  yoke/ 
pedal  combinations  of  varying  quality  (Peterson,  1 993) . 


There  is  evidence  of  positive  transfer  of  PCATDs  to 
the  airplane  (Phillips,  Hulin,  &  Lamermayer,  1993; 
Ortiz,  1993,  1994;  Dennis,  1994),  although  the  em¬ 
pirical  evaluations  have  been  limited  in  scope.  Experi¬ 
mental  data  bearing  on  issues  of  skill  transfer  are 
equivocal,  and  there  is  no  means  of  ascertaining  the 
training  effectiveness  of  a  PCATD  without  an  empiri¬ 
cal  test  of  its  impact  on  transfer  of  skills  to  flight 
performance.  Specifically,  it  is  necessary  to  determine 
the  types  of  flight  tasks  that  can  be  trained  effectively 
in  the  PCATD  and  the  level  of  proficiency  obtained 
by  practice  with  a  PCATD.  Analytical  evaluation  of 
PCATDs  indicates  that  they  provide  many  of  the 
features  required  for  standard  instrument  flight  ma¬ 
neuvers.  Instrument  training  in  a  PCATD  may  result 
in  substantial  transfer  for  instrument  flight  tasks. 

To  evaluate  transfer  of  training,  the  performance  of 
a  group  of  subjects  trained  in  a  flight  training  device, 
and  later  trained  to  criterion  in  an  aircraft,  is  com¬ 
pared  with  the  performance  of  a  control  group  of 
subjects  who  have  been  trained  only  in  the  airplane.  A 
conventional  measure  of  transfer  of  training  has  been 
percent  transfer,  which  is  known  to  be  a  negatively- 
accelerated  function.  Roscoe  (1971)  and  Roscoe  and 
Williges  (1980)  correctly  pointed  out  that  percent 
transfer  fails  to  consider  the  amount  of  practice  in  the 
flight  training  device  in  determining  the  training 
effectiveness  of  the  device.  The  transfer  effectiveness 
ratio  (TER),  a  negatively-decelerated  function,  has 
been  used  to  determine  the  ratio  of  the  trials/time  in 
the  airplane  saved  by  the  training  device  group,  com¬ 
pared  with  the  airplane  group,  as  a  function  of  the 
number  of  trials/ time  in  the  training  device  (Williams 
&  Flexman,  1949;  Roscoe,  1971). 

Many  of  the  applied  research  studies  on  flight 
training  effectiveness  have  examined  the  effect  of 
specific  simulator  features  on  specific  tasks  (e.g., 
Lintern,  Roscoe,  Koonce  &  Segal,  1990;  Taylor, 


1 


Lintern,  Koonce,  Kaiser,  &  Morrison,  1991).  The 
first  transfer  of  training  evaluations  of  PCATDs 
(Phillips  et  ah,  1993;  Ortiz,  1993,  1994;  Dennis, 
1994)  have  followed  that  pattern.  Only  a  few  experi¬ 
ments  have  examined  the  impact  of  a  single  device  on 
a  whole  course  (e.g.,  Povenmire  &  Roscoe,  1971, 
1973).  Transfer  studies  conducted  in  1949/50,  but 
first  reported  by  Flexman,  Roscoe,  Williams,  and 
Williges  (1972),  used  percent  transfer  and  transfer 
effectiveness  ratios  in  terms  of  errors,  time  to  crite¬ 
rion,  and  trials  to  criterion  to  assess  a  comprehensive 
set  of  contact  and  instrument  flight  tasks.  The  Flexman 
et  al.  (1972)  study  remains  the  most  definitive  study 
of  the  effectiveness  of  flight  training  devices  for  a  total 
flight  course.  It  described  a  research  plan  that  was 
implemented  in  the  current  evaluation  of  PCATDs. 

Williams  and  Blanchard  (1995),  proposed  that 
task  analysis  be  used  as  a  basis  for  predicting  transfer 
effectiveness.  The  appropriate  task  analysis  would 
identify  the  learning  requirements  for  a  particular 
flight  task,  and  these  requirements  would  then  be 
organized  in  terms  of  common  features.  An  analysis  of 
the  PCATD  would  determine  which  learning  require¬ 
ments  could  be  supported  by  that  device  and,  conse¬ 
quently,  which  flight  tasks  could  be  taught  in  the 
PCATD.  They  proposed  that  the  initial  validation  of 
the  guidelines  would  be  accomplished  through  the 
collection  of  performance  data  from  FAR  Part  I4l 
schools  using  PCATDs.  The  purpose  of  the  present 
study  is  to  determine  the  extent  to  which  a  PCATD 
can  be  used  to  develop  specific  instrument  skills  that 
are  taught  in  instrument  flight  training  and  to  mea¬ 
sure  transfer  of  these  skills  to  the  aircraft.  The  ap¬ 
proach  taken  in  this  study  is  to  use  a  representative 
PCATD  to  teach  instrument  tasks  in  the  two-semester 
instrument  training  course  at  the  University  of  Illi¬ 
nois  Institute  of  Aviation. 

Our  training  course  outline  for  the  PCATD  em¬ 
phasized  instruction  of  specific  maneuvers  in  order  to 
determine  if  the  PCATD  was  an  effective  training 
device  for  a  variety  of  instrument  tasks.  For  each  flight 
lesson,  which  was  programmed  to  be  accomplished  in 
one  week,  one  or  more  instrument  tasks  were  intro¬ 
duced  and/or  reviewed.  Progression  to  the  next  flight 
lesson,  however,  required  that  the  student  meet  the 


objectives  in  that  flight  lesson.  Advancement  to  the 
next  flight  lesson,  therefore,  was  based  on  demon¬ 
strated  proficiency  on  the  respective  instrument  tasks. 
For  the  PCATD  group,  proficiency  had  to  be  demon¬ 
strated  in  the  PCATD  prior  to  flying  the  flight  lesson 
in  the  airplane.  The  PCATD  group  was  required  to 
demonstrate  their  proficiency  in  the  airplane  on  a 
respective  flight  lesson  prior  to  attempting  the  next 
flight  lesson.  The  Airplane  group  received  all  of  their 
instrument  training  in  the  airplane  but  also  had  to 
demonstrate  proficiency  in  the  airplane  on  each  flight 
lesson  prior  to  advancing  to  the  next  flight  lesson.  The 
effectiveness  of  the  PCATD  in  teaching  specific  in¬ 
strument  tasks  in  a  flight  lesson  was  measured  by 
comparing  the  trials  required  for  the  PCATD  group 
and  the  Airplane  group  to  reach  proficiency  in  the 
airplane  on  specific  instrument  tasks.  Subsequently, 
the  percent  transfer  and  TER  for  trials  were  computed 
for  each  instrument  task.  The  effectiveness  of  using 
the  PCATD  to  reach  proficiency  for  a  particular  flight 
lesson  was  measured  by  comparing  the  time  required 
for  the  PCATD  group  and  the  Airplane  group  to 
complete  the  objectives  of  the  flight  lesson  in  the 
airplane.  Subsequently,  the  percent  transfer  and  TER 
for  time  to  complete  the  lesson  were  computed. 

Early  in  training,  the  emphasis  was  on  basic  control 
skills  with  reference  to  instruments.  Instruction  then 
progressed  through  increasingly  challenging  exercises 
with  emphasis  on  instrument  holding  patterns,  in¬ 
strument  approaches,  and  preparation  for  cross-coun¬ 
try  flights.  In  each  flight  lesson,  transfer  on  specific 
instrument  tasks  was  evaluated;  transfer  relative  to 
logged  airplane  time  to  satisfy  the  completion  stan¬ 
dards  for  that  lesson  was  also  assessed.  In  many  les¬ 
sons,  the  logged  time  to  satisfy  completion  standards 
represents  student  progress  on  more  than  just  the  tasks 
tested  in  the  lesson.  Any  discrepancy  between  trials  to 
proficiency  and  time  to  proficiency  may  reflect  differ¬ 
ential  progress  with  relation  to  the  rated  instrument 
tasks  and  those  other  lesson  objectives. 

An  earlier  interim  report  by  Taylor,  Lintern,  and 
Hulin  (1995)  provided  the  results  of  the  first  year’s  work. 
This  was  also  reported  by  Taylor,  Lintern,  Hulin, 
Emanuel,  Phillips,  and  Talleur  (1995),  and  Taylor, 
Lintern,  Hulin,  Talleur,  Phillips,  and  Emanuel  (1996). 
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METHOD 

Subjects 

One-hundred  forty-four  subjects  were  tested  in  a 
transfer  of  training  design.  These  subjects  were  en¬ 
rolled  in  instrument  flight  instruction  at  the  Univer¬ 
sity  of  Illinois.  A  total  of  1 17  subjects  were  enrolled  in 
basic  instrument  instruction  (Aviation  130);  40  in  the 
Fall,  1994  semester;  17  in  the  Spring,  1995  semester; 
12  in  the  Summer,  1995  semester;  37  in  the  Fall,  1995 
semester;  and  1 1  in  the  Spring,  1996  semester.  Ten  of 
the  subjects  enrolled  in  Aviation  130  in  the  Fall  1995 
received  training  in  an  integrated  curriculum,  which 
used  both  a  PCATD  and  a  Frasca  140  training  device. 
The  results  of  this  preliminary  study  are  reported  by 
Taylor,  Lintern,  Hulin,  Talleur,  Emanuel,  and  Phillips 
(1996a).  The  remaining  27  students  were  enrolled  in 
the  advanced  instruments  course  (Aviation  140)  in 
the  Fall,  1994  semester.  Seventy-seven  of  the  students 
who  completed  Aviation  130  completed  the  experi¬ 
ment  as  Aviation  140  students.  The  subjects  were 
restricted  to  students  between  1 8  and  30  years  old  who 
had  taken  their  private  pilot  training  at  the  University 
of  Illinois  or  had  completed  a  familiarization  course 
and  were  recommended  for  Aviation  130. 

Subjects  were  randomly  assigned  to  the  PCATD 
group  and  the  Airplane  group,  with  the  constraint 
that  male  and  female  students  were  distributed  evenly 
over  the  two  groups.  Students  in  the  PCATD  group 
were  taught  specific  instrument  tasks  on  the  PCATD 
to  a  specified  criterion  and  were  then  transferred  to 
the  aircraft,  where  they  were  required  to  perform  these 
tasks  again  to  the  same  criterion.  Comparisons  were 
made  with  a  Control  group  that  had  received  similar 
training  only  in  an  airplane.  Students  from  both 
groups  were  required  to  achieve  criterion  on  those 
tasks  in  the  airplane  prior  to  moving  to  the  next  flight 
lesson.  The  Fall  1994  Aviation  140  data  set  will  be 
presented  separately,  since  these  students  had  no  pre¬ 
vious  experience  with  PCATDs,  while  the  remaining 
Aviation  140  students  in  the  PCATD  group  had 
received  basic  instrument  training  in  the  PCATD.  Of 
the  92  subjects  who  completed  Aviation  130,  45 
subjects  were  assigned  to  the  Airplane  group,  and  47 


subjects  were  assigned  to  the  PCATD  group.  Of  these 
92  subjects,  74  subjects  completed  Aviation  140;  36 
subjects  were  assigned  the  Airplane  group,  and  38 
were  assigned  to  the  PCATD  group. 

Apparatus 

A  representative  PCATD  system  that  would  be 
affordable  for  the  majority  of  FAR  Part  1 4 1  -  approved 
schools  was  assembled  from  commercially  available, 
state-of-the-art  but  proven  PCATD  technology.  The 
choice  of  PCATD  components  was  established  in  a 
discussion  with  the  Civil  Aeromedical  Institute’s 
Human  Factors  Research  group  on  July  22,  1994. 
Figure  1  shows  the  system,  based  on  the  criteria  of 
representativeness,  capability,  and  cost,  which  in¬ 
cluded  MDM  FS 1 00  software,  modified  for  Beechcraft 
Sundowner  performance  characteristics,  an  IBM-com¬ 
patible  Pentium,  60MHz  computer,  an  instructor 
station  map  display,  flight  controls  by  Precision  Flight 
Controls  (see  Figure  2),  and  a  20-inch  monitor  and 
hood.  The  20-inch  monitor  permitted  display  of  6 
standard  3.0-inch  instruments.  The  system  is  de¬ 
scribed  in  more  detail  in  Appendix  1  of  the  University 
of  Illinois  contract  report  (Taylor,  Lintern,  Hulin, 
Talleur,  Emanuel  &  Phillips,  1996b).  The  training 
aircraft  used  were  Beechcraft  Sports/Sundowners, 
which  have  a  single-engine,  fixed-pitch  propeller,  and 
fixed  landing  gear. 

Procedure 

Instrument  training  at  the  University  of  Illinois  is 
conducted  in  a  two-semester  sequence.  Basic  instru¬ 
ment  procedures  emphasizing  aircraft  control,  instru¬ 
ment  departure,  enroute  and  approach  procedures  are 
taught  during  the  first  semester  in  Aviation  130; 
remaining  instrument  skills  are  taught  during  the 
second  semester  in  Aviation  140  (Table  1).  The  objec¬ 
tive  of  the  courses  is  to  develop  the  basic  skills  neces¬ 
sary  for  the  control  and  accurate  maneuvering  of  an 
airplane  solely  by  reference  to  flight  instruments; 
specifically,  the  skills  necessary  to  perform  IFR  flight, 
including  departure,  enroute,  and  arrival  procedures. 

During  each  semester,  the  students  are  scheduled  for 
45  hours  of  lecture  (ground  school)  and  1 5  flight  lessons, 
each  programmed  for  one  week.  An  experimental 
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Figure  2.  More  detailed  view  of  student  flight  console  with  rudder  pedal 
assembly.  Also  shows  avionics  console  to  right. 
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Table  1 .  Summary  of  Training  Course  Outlines  for  Aviation  130,  the  First  Semester  Instrument 
Rating  Course,  and  Aviation  140,  the  Second  Semester  Instrument  Rating  Course. 

Lesson^  Content 

31  Review  private  pilot  maneuvers 

32  VFR  cross-country  flight  review 

33  T wo  solo  cross-country  flights 

34  Introduce  basic  instrument  flight  skills 

35  Review  basic  instrument  flight  skills.  Introduce  attitude  instrument  flight  with  distractions 

36  Introduce  VOR  use  and  orientation,  VOR  radial  intersection  holding  patterns 

37  Introduce  ILS,  VOR,  and  LOG  BC  instrument  approach  procedures,  procedure  turns,  radar 
vectoring,  review  VOR  tracking 

38  Introduce  DME  Arcs,  review  holding  patterns  and  instrument  approaches 

39  Introduce  instrument  cross-country  flight  procedures 

40  Review  holding  patterns  and  instrument  approach  procedures 

41  Review  holding  patterns  and  instrument  approach  procedures 

42  Review  instrument  cross-country  flight  procedures 

43  Review  holding  patterns  and  instrument  approach  procedures 

44  Review  all  content  areas,  mock  stage  check  with  a  different  instructor 

45  Review  and  stage  check 

46  Review  private  pilot  maneuvers,  review  basic  instrument  flying  skills,  solo  cross-country  flight 

47  Review  basic  instrument  flying  skills 

48  Review  DME  Arcs,  ILS,  VOR,  and  LOG  BG  approaches 

49  Introduce  NDB  tracking,  NDB  holding  patterns,  NDB  instrument  approaches 

50  Introduce  localizer  and  localizer  back  course  holding  patterns,  review  NDB  skills 

51  Introduce  partial  panel  basic  attitude  instrument  flying  skills,  review  instrument  approaches 

52  Introduce  partial  panel  instrument  approaches  and  holding  patterns 

53  Review  instrument  cross-country  flying  skills  and  procedures 

54  Review  instrument  cross-country  flying  skills  and  procedures 

55  Review  instrument  cross-country  flying  skills  and  procedures,  introduce  night  procedures 

56  250  nm  IFR  cross-country  flight,  also  a  review  flight 

57  Review  instrument  cross-country  flying  skills  and  procedures 

58  Mock  stage  check  with  a  different  instructor 

59  Review  for  instrument  stage  check 

60  Stage  check 

^Flight  Lessons  1-30  are  allocated  to  Aviation  101  and  120,  which  lead  to  Private  Pilot  Gertification. 
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curriculum  for  both  the  PCATD  group  and  the  Air¬ 
plane  group  (control)  was  developed  (Emanuel,  Tay¬ 
lor,  Hulin,  Lintern,  Phillips,  &  Talleur,  1995). 

For  the  PCATD  group,  all  new  maneuvers  and 
procedures  were  introduced  and  trained  to  profi¬ 
ciency  in  a  PCATD  prior  to  training  and  skill  valida¬ 
tion  in  the  aircraft.  For  the  Airplane  group,  all  new 
maneuvers  were  introduced  and  trained  to  profi¬ 
ciency  in  the  airplane.  Tasks  within  a  flight  lesson, 
trained  in  the  PCATD,  were  trained  or  tested  for 
proficiency  in  the  airplane  before  proceeding  to  the 
next  flight  lesson.  Subjects  in  the  Airplane  group  were 
trained  on  the  same  tasks  but  in  the  airplane  only. 

Instructors  rated  student  performances  on  desig¬ 
nated  flight  tasks  in  both  the  PCATD  and  the  aircraft. 
For  performance  assessment  in  the  aircraft,  each  in¬ 
structor  used  a  rating  scale  developed  for  each  flight 
lesson  to  record  whether  the  student  met  the  comple¬ 
tion  standards  during  the  execution  of  the  designated 
flight  tasks.  Instructors  also  recorded  trials  to  crite¬ 
rion  for  specific  tasks  and  flight  time  to  complete 
flight  lessons.  The  rating  scales  used  in  the  project 
were  modeled  on  those  that  have  been  used  in  previ¬ 
ous  flight  research  at  the  University  of  Illinois,  and  are 
described  in  detail  in  an  earlier  paper  (Phillips,  Tay¬ 
lor,  Lintern,  Hulin,  Emanuel,  &  Talleur,  1995).  In¬ 
ter-rater  reliabilities  of  0. 80  on  these  types  of  scales  are 
typically  achieved  (Koonce,  1979).  The  rating  scales 
were  used  for  both  the  PCATD  group  and  for  the 
Airplane  group.  For  the  PCATD  group,  two  identical 
rating  scales  were  developed  for  each  flight  lesson  (or 
a  series  of  related  flight  lessons) :  one  for  training  in  the 
PCATD  and  one  for  training  in  the  aircraft  after 
reaching  criterion  in  the  PCATD.  An  identical  rating 
scale  was  used  for  each  flight  lesson  for  the  Airplane 
group.  The  rating  scales  can  be  found  in  Appendix  2 
of  Taylor  et  al.  (1996b). 

The  guiding  principles  behind  the  development 
and  scoring  of  these  maneuver-assessment  scales  were 
to  attempt  to  digitize  the  observing  and  scoring  tasks 
of  the  instructor/observers.  Maneuvers  were  divided 
into  time  segments,  and  the  instructors  were  asked  to 
record  specific  flight  parameters,  say,  within±  1 00  feet 
of  the  assigned  altitude  or  exceeding  this  range;  within 
±5''  of  assigned  heading  or  outside  this  range.  By 


breaking  up  the  flight  maneuvers  into  many  param¬ 
eters  whose  values  define  the  quality  of  the  maneuver, 
taking  digitized  assessments  at  specified  times,  and 
summing  these  digitized  assessments  across  many 
flight  parameters  and  times,  the  overall  quality  of  the 
total  maneuver  and  flight  can  be  captured  very  accu¬ 
rately.  In  addition,  the  workload  on  the  flight  instruc¬ 
tors  was  significantly  reduced.  They  only  had  to 
glance  at  one  or  two  instruments  at  specified  times 
and  note  whether  the  student  was  within  the  range 
printed  on  their  scoring  sheets.  By  reducing  the  im¬ 
plicit  analogue  task  from  integrating  a  student^s  per¬ 
formance  on  all  parameters  throughout  a  maneuver 
and  attempting  to  summarize  the  overall  quality  of 
their  performance  to  recording  a  small  number  of 
digitized  scores,  we  were  able  to  maintain  flight  safety 
standards  while  recording  performance  levels. 

Experienced  flight  instructors  at  the  University  of 
Illinois  served  as  both  flight  instructors  and  experi¬ 
menters  in  the  project.  The  instructors  were  trained 
on  delivery  of  the  instructional  curriculum  and  on  the 
use  of  the  rating  scales.  Three  check  pilots,  who  were 
uninformed  as  to  the  allocation  of  students  to  training 
conditions,  were  used  for  the  stage  checks. 


Analyses 

Percent  transfer  and  transfer  effectiveness  ratios 
(TERs)  were  computed  for  each  flight  lesson  using  the 
following  equations: 

Yc- Yx 

- X  100  =  Percent  Transfer 

Yc 


Yc-Yx 

X 


Transfer  Effectiveness  Ratio 


Where:  Y^  =  Time/Trials  in  airplane  by  Airplane 
group 

Y^  =  Time/Trials  in  airplane  by  PCATD 
group 

=  Time/Trials  in  airplane  by  PCATD 
group 


Percent  Transfer  measures  the  difference  between 
the  airplane  and  the  PCATD  groups  in  terms  of  trials/ 
time  to  reach  criterion  in  the  airplane,  expressed  as  a 
percent.  A  positive  percent  transfer  favors  the  PCATD 
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Table  2.  Instrument  tasks  in  Aviation  130  and  Aviation  140  for  which  percent  transfer  and  TERs 
for  mean  trials  to  criterion  and  mean  time  to  complete  the  flight  lesson  were  calculated. 


Task 

Fliaht  Lesson** 

1 130 

Steep  Turns 

34/35 

Intersection  Holds 

36,  40-43,  42 

Instrument  Landing  System  (ILS)  Approach 

37,  38,  39,  40-43,  42 

Localizer  Back  Course  (LOG  BC)  Approach 

37,  39,  40-43 

Visual  Omni  Range  (VOR)  Approach* 

38,  40-43,  42 

Distance  Measuring  Equipment  Arc  Approach 

38 

(DME  Arc) 

1 140 

Intersection  Holds 

48 

ILS  Approaches 

48,  51,52,  53,  56,  57 

VOR  Approaches 

48,  51, 52,  53,  56,  57 

NDB  Holds 

49,  50 

NDB  Approaches 

49,  50,  51,  52,  53,  54,  55,  56 

LOG  BC  Holds 

50 

ILS  Holds 

50 

LOG  BC  Approaches 

52 

Holding  Patterns 

52,  53,  54,  55,  56,  57 

*VOR  approaches  were  first  introduced  in  Flight  Lesson  37,  but  instructions  for  scoring  this  exercise  were 
inadvertently  omitted  from  the  score  sheet. 

**See  Table  1  for  the  lesson  descriptions  for  the  respective  flight  lessons. 


group,  and  a  negative  percent  transfer  favors  the 
Airplane  group.  Percent  Transfer  does  not  consider 
the  amount  of  prior  training  in  the  PCATD  by  the 
PCATD  group.  Transfer  effectiveness  ratio  (TER) 
measures  the  difference  between  the  airplane  and  the 
PCATD  groups  in  terms  of  trials/time  to  reach  crite¬ 
rion  in  the  airplane,  as  a  function  of  the  amount  of 
prior  training  in  the  PCATD  by  the  PCATD  group, 
i.e.,  TER  measures  the  effectiveness  of  the  PCATD  in 
training  specific  instrument  tasks. 

In  all  instrument  tasks  in  Aviation  130  and  Avia¬ 
tion  140,  students  were  trained  to  proficiency  in  the 
PCATD  and  then  trained  and  tested  in  the  airplane. 
Table  2  shows  the  instrument  tasks  trained  in  Avia¬ 
tion  130  and  Aviation  140,  for  which  mean  percent 
transfer  and  mean  transfer  effectiveness  ratios  (TERs) 
were  computed  from  mean  trials  to  criterion  and  from 
mean  time  to  complete  the  flight  lesson. 


RESULTS 

Mean  percent  transfer  and  mean  transfer  effective¬ 
ness  ratios  (TERs)  are  reported  for  two  dependent 
measures:  number  of  trials  to  criterion  for  selected 
instrument  tasks  (trials),  and  airplane  time  required  in 
a  flight  lesson  for  students  to  reach  the  completion 
standards  (time).  In  addition,  means  and  variances  of 
Trials  to  Criterion 

The  mean  trials  used  to  compute  percent  transfer 
and  TERs  for  trials  on  instrument  tasks  trained  in 
Aviation  130  are  shown  in  Table  3.  It  is  evident  from 
this  table  that  the  PCATD  was  more  effective  for 
introduction  of  tasks  than  for  their  review.  For  most 
tasks,  positive  transfer  was  found  in  the  flight  lesson 
during  which  the  tasks  were  introduced.  With  steep 
turns,  for  example,  the  Airplane  group  (N=54)  re¬ 
quired  a  mean  of  3.83  airplane  trials  to  reach  criterion. 
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while  the  PCATD  group  (N=53)  required  a  mean  of 
3.40  airplane  trials  after  a  mean  of  3.28  prior  trials  in 
the  PCATD.  The  percent  transfer  was  11.2%,  and  the 
transfer  effectiveness  ratio  (TER)  was  0.13.  Therefore 
for  this  task,  within  the  limit  of  the  number  of  trials 
administered,  each  trial  in  the  PCATD  saved  0.13 
trials  in  the  airplane.  The  difference  between  the 
means  of  0.43  trials  as  tested  by  a  t-test  (two  tailed) 
was  nonsignificant.  For  two  tasks,  ILS  approach  and 
VOR  approach,  the  percent  transfer  was  33.3%  (ILS, 
Flight  Lesson  37)  and  20.4%  (VOR,  Flight  Lesson 
38).  The  TERs  for  these  two  tasks  were  0.28  (ILS, 
Flight  Lesson  37)  and  0.25  (VOR,  Flight  Lesson  38). 
For  each  of  the  tasks,  each  prior  training  trial  in  the 
PCATD  saved  one  fourth  or  more  trials  in  the  air¬ 
plane.  For  the  ILS  task  (Flight  Lesson  37),  the  PCATD 
group  required  1.50  mean  trials  to  reach  criterion  in 
the  airplane,  compared  with  2.25  mean  trials  for  the 
Airplane  group.  The  difference  between  the  means  of 
0.75  trials  was  significant:  t(86)  =  4.18,  p  <  0.001 
(two-tailed). 

For  the  VOR  task  (Flight  Lesson  38),  the  PCATD 
group  required  1.33  mean  trials  to  reach  criterion, 
compared  with  1.67  for  the  Airplane  group.  The 
difference  between  the  means  of  0.34  trials  was  sig¬ 
nificant:  t(93)  =  2.37,  p  <  0.02  (two-tailed).  For 
localizer,  back  course  (LOC  BC)  (Flight  Lesson  37) 
and  the  DME/Arc  (Flight  Lesson  38)  approaches,  the 
transfers  were  17.5%  and  18.1%,  respectively.  The 
TERs  for  these  2  tasks  were  0.17  (LOC  BC)  and  0.20 
(DME/Arc).  For  the  LOC  BC  (Flight  Lesson  37),  the 
PCATD  group  required  1.46  mean  trials  to  reach 
criterion  compared  with  1 .77  for  the  Airplane  group. 
The  difference  of  0.31  trials  was  not  significant:  t(97) 
=  1.73,  p  <  0.09  (two-tailed).  Similarly,  the  mean 
trials  to  criterion  on  the  DME/Arc  task  (Flight  Lesson 
38)  was  1.58  for  the  PCATD  group  compared  with 
1.93  for  the  Airplane  group.  The  difference  between 
the  means  of  0.35  trials  was  not  significant:  t(98)  = 
1.84,  p  <  0.07  (two-tailed). 

Additional  training  was  given  on  each  task  after  the 
flight  lesson  in  which  a  task  was  introduced.  For 
example,  the  ILS  approach  and  the  LOC  BC  approach 
were  introduced  in  Flight  Lesson  37.  Additional  train¬ 
ing  was  conducted  on  the  ILS  in  Flight  Lesson  38  and 
on  the  LOC  BC  approach  in  Flight  Lesson  39.  As  seen 


in  Table  3,  the  mean  number  of  trials  to  reach  profi¬ 
ciency  in  the  airplane  for  the  Airplane  group  and  the 
PCATD  group  was  substantially  smaller  for  Flight 
Lessons  38  and  39  compared  with  Flight  Lesson  37,  as 
was  the  mean  number  of  trials  to  reach  proficiency  in 
the  PCATD.  For  example,  for  the  ILS  task  in  Flight 
Lesson  37,  the  Airplane  and  the  PCATD  groups 
required  2.25  and  1.5  trials,  respectively,  to  reach 
proficiency  in  the  airplane  after  2.70  prior  trials  in  the 
PCATD  by  the  PCATD  group.  Review  of  the  ILS  in 
Flight  Lesson  38,  however,  indicates  that  the  Airplane 
and  PCATD  groups  required  only  1.36  and  1.20 
trials,  respectively,  to  reach  proficiency  in  the  airplane 
after  1.33  prior  trials  in  the  PCATD  by  the  PCATD 
group.  The  difference  between  the  means  was  not 
significant.  For  Flight  Lessons  38  and  39,  the  effec¬ 
tiveness  of  the  prior  training  in  the  PCATD,  as  de¬ 
fined  by  percent  transfer  and  the  TER,  was  also 
reduced.  For  example,  for  the  ILS  task,  the  percent 
transfer  was  33.3%  in  Flight  lesson  37  and  1 1.8%  in 
Flight  Lesson  38;  the  TER  was  0.28  in  Flight  Lesson 
37  and  0.12  in  Flight  Lesson  38. 

The  means  used  to  compute  percent  transfer  and 
TERs  for  instrument  tasks  trained  in  Aviation  140 
after  the  students  had  completed  the  experimental 
program  in  Aviation  130  are  shown  in  Table  4.  Flight 
Lesson  48  was  a  review  of  ILS  and  VOR  tasks  that  had 
been  introduced  and  reviewed  extensively  during  the 
previous  semester  in  Aviation  130.  The  percent  trans¬ 
fer  for  ILS  was  18.7%  and  the  TER  was  0.23.  The 
mean  trials  to  reach  criterion  for  the  ILS  task  in  Flight 
Lesson  48  was  1 .26  mean  trials  for  the  PCATD  group 
and  1.55  mean  trials  for  the  Airplane  group.  The 
difference  between  the  means  of  0.29  trials  was  not 
significant:  t(57)  =  1.60,p<  0.12  (two-tailed).  For  the 
VOR,  the  percent  transfer  was  14.6%  and  the  TER 
was  0.17.  For  the  VOR  task  in  Flight  Lesson  48,  the 
PCATD  group  required  1.05  mean  trials  to  reach 
criterion  compared  with  1.23  trials  for  the  Airplane 
group.  The  difference  between  the  means  of  0.18  trials 
was  significant:  t(50)  =  2.20,  ^  <  0.03  (two-tailed). 

Non  Directional  Beacon  (NDB)  holds  and  ap¬ 
proaches  were  introduced  in  Flight  Lesson  49.  Posi¬ 
tive  transfer  was  found  for  the  mean  trials  to  proficiency 
for  the  NDB  holds  and  the  NDB  approaches  in  that 
lesson.  The  percent  transfer  for  NDB  holds  and 
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Table  3.  Mean  trials  in  the  airplane  for  the  Airplane  group  (Yc)  and  the  PCATD  group  (Yx),  and  the 
mean  trials  in  the  PCATD  (X),  percent  transfer  and  training  effectiveness  ratios  (TERs)  for 
instrument  tasks  trained  in  Aviation  130.  Levels  of  statistical  significances  of  differences  between 
Yc  and  Yx  are  shown. 


Task 

Group 

E 

Percent 

T  ransfer 

TER 

Yc 

Yx 

X 

Steep  T urns  (Fit  Lessons  34/35) 

3.83 

3.40 

3.28 

ns 

11.2% 

0.13 

Int  Hold  (Fit  Lesson  36)** 

ILS  (Fit  Lesson  37) 

2.25 

1.50 

2.70 

<0.001 

33.3% 

0.28 

LOC  BC  (Fit  Lesson  37) 

1.77 

1.46 

1.81 

<0.09 

17.5% 

0.17 

VOR  (Fit  Lesson  38) 

1.67 

1.33 

1.38 

<0.02 

20.4% 

0.25 

ILS  (Fit  Lesson  38)* 

1.36 

1.20 

1.33 

ns 

11.8% 

0.12 

DME/Arc  (Fit  Lesson  38) 

1.93 

1.58 

1.76 

<0.07 

18.1% 

0.20 

ILS  (Fit  Lesson  39)* 

1.40 

1.50 

1.29 

ns 

7.9% 

0.10 

LOC  BC  (Fit  Lesson  39)* 

1.51 

1.47 

1.49 

ns 

2.7% 

0.03 

ILS  (Fit  Lessons  40,41,43)* 

2.94 

3.10 

2.69 

ns 

5.4% 

0.06 

LOC  BC  (Fit  Lessons  40,41,43)* 

1.87 

1.70 

1.62 

ns 

4.9% 

0.10 

VOR  (Fit  Lessons  40,41 ,43)* 

3.33 

3.30 

2.47 

ns 

1.0% 

0.01 

ILS  (Fit  Lesson  42)* 

1.39 

1.59 

1.44 

ns 

-3.6% 

-0.03 

VOR  (Fit  Lesson  42)* 

1.13 

1.06 

1.16 

ns 

-2.3% 

-0.03 

*Review  tasks. 

**An  incorrect  definition  of  a  hold  trial  precluded  meaningful  data  collection. 


approach  was  19.7%  and  21.0%,  respectively,  and  the 
TERs  were  0. 16  and  0.17,  respectively.  For  the  NDB 
holds  task,  the  PCATD  group  required  1.18  mean 
trials;  the  Airplane  group  required  1.47  trials  to  reach 
criterion.  The  difference  of  0.29  trials  was  not  signifi¬ 
cant:  t(57)  =  1.93,p<0.06  (two-tailed).  The  PCATD 
group  required  1.54  NDB  approach  trials  to  reach 
criterion  compared  with  1.95  mean  approach  trials 
for  the  Airplane  group.  The  difference  between  the 
means  was  significant:  t(67)  =  2.29,  g  <  0.03  (two- 
tailed).  The  review  of  NDB  holds  and  approaches  in 
the  PCATD  during  Flight  Lesson  50  also  produced 
positive  transfer.  The  percent  transfer  for  NDB  holds 
was  15.8%,  and  the  TER  was  0.16.  These  scores  were 
about  the  same  as  the  percent  transfer  and  TER  for 
holds  when  previously  introduced  in  Flight  Lesson 


49.  In  Flight  Lesson  50,  the  PCATD  group  required 
1 . 12  hold  trials  to  reach  criterion  compared  with  1 .33 
trials  for  the  Airplane  group.  The  difference  between 
the  means  was  significant:  t(59)  =  2.05,p  <  0.05  (two- 
tailed).  For  review  of  NDB  Approaches  in  Flight 
Lesson  50,  the  percent  transfer  was  28.1%  and  the 
TER  was  0.39,  both  of  which  were  larger  than  the 
values  found  for  Flight  Lesson  49  when  NDB  ap¬ 
proaches  were  introduced.  For  the  NDB  approach 
task  in  Flight  Lesson  50,  the  PCATD  group  required 
1.18  mean  trials  to  reach  criterion  compared  with 
1.64  mean  trials  for  the  Airplane  group.  The  differ¬ 
ence  between  the  means  of  0.46  was  significant,  t(54) 
=  2.70,  p  <  0.01  (two-tailed).  The  LOC  BC  holds  in 
Flight  Lesson  50  also  showed  a  significant  amount  of 
transfer.  Percent  transfer  was  26.5%  and  the  TER  was 
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Table  4.  Mean  trials  in  the  airpiane  for  the  Airpiane  group  (Yc)  and  the  PCATD  group  (Yx),  mean 
trials  in  the  PCATD  (X),  percent  transfer  and  training  effectiveness  ratios  (TERs),  for  selected 
instrument  tasks  trained  in  Aviation  140  after  the  students  completed  experimental  training  in 
Aviation  130.  Levels  of  statistical  significances  of  differences  between  Yc  and  Yx  are  shown. 

Percent 


Task 

Group 

e 

Transfer 

TER 

Yc 

Yx 

X 

ILS  (Fit  Lesson  48) 

1.55 

1.26 

1.26 

ns 

18.7% 

0.23 

VOR  (Fit  Lesson  48) 

1.23 

1.05 

1.05 

<0.03 

14.6% 

0.17 

NDB  Holds  (Fit  Lesson  49) 

1.47 

1.18 

1.87 

<0.06 

19.7% 

0.16 

NDB  Approach  (Fit  Lesson  49) 

1.95 

1.54 

2.36 

<0.03 

21 .0% 

0.17 

NDB  Holds  (Fit  Lesson  50) 

1.33 

1.12 

1.33 

<0.05 

15.8% 

0.16 

NDB  Approach  (Fit  Lesson  50) 

1.64 

1.18 

1.18 

<0.01 

28.1% 

0.39 

LOG  BC  Holds  (Fit  Lesson  50) 

1.47 

1.08 

1.29 

<0.03 

26.5% 

0.30 

ILS  Holds  (Fit  Lesson  50) 

1.14 

1.11 

1.14 

ns 

2.6% 

0.03 

ILS  (Fit  Lesson  51)* 

1.10 

1.03 

1.20 

ns 

6.4% 

0.06 

NDB  (Fit  Lesson  51)* 

1.15 

1.13 

1.21 

ns 

1.7% 

0.02 

VOR  (Fit  Lesson  51)* 

1.10 

1.00 

1.10 

ns 

9.1% 

0.09 

ILS  (Fit  Lesson  52)* 

1.09 

1.22 

1.16 

ns 

-11.9% 

-0.11 

VOR  (Fit  Lesson  52)* 

1.17 

1.29 

1.51 

ns 

-13.2% 

-0.10 

NDB  (Fit  Lesson  52)* 

1.14 

1.19 

1.73 

ns 

-1 .7% 

-0.01 

LOG  BG  (Fit  Lesson  52)* 

1.15 

1.10 

1.19 

ns 

4.4% 

0.04 

ILS  (Fit  Lesson  53)* 

1.29 

1.14 

1.18 

ns 

1 1 .6% 

0.13 

VOR  (Fit  Lesson  53)* 

1.06 

1.00 

1.12 

ns 

5.1% 

0.05 

NDB  (Fit  Lesson  53)* 

1.06 

1.06 

1.07 

ns 

0.0% 

0.00 

Holds  (Fit  Lesson  53)* 

1.07 

1.14 

1.04 

ns 

-6.5% 

-0.07 

NDB  (Fit  Lesson  54)* 

1.45 

1.34 

1.21 

ns 

7.6% 

0.09 

Holds  (Fit  Lesson  54)* 

1.23 

1.03 

1.12 

ns 

16.3% 

0.18 

NDB  (Fit  Lesson  55)* 

1.62 

1.56 

1.61 

ns 

3.7% 

0.04 

Holds  (Fit  Lesson  55)* 

1.11 

1.24 

1.09 

ns 

-11.7% 

-0.12 

ILS  (Fit  Lesson  56)* 

1.14 

1.11 

1.17 

ns 

2.6% 

0.03 

VOR  (Fit  Lesson  56)* 

1.22 

1.06 

1.16 

ns 

4.9% 

0.06 

Holds  (Fit  Lesson  56)* 

1.22 

1.11 

1.20 

ns 

9.0% 

0.09 

ILS  (Fit  Lesson  57)* 

1.14 

1.14 

1.03 

ns 

0.0% 

0.00 

VOR  (Fit  Lesson  57)* 

1.14 

1.14 

1.03 

ns 

0.0% 

0.00 

Holds  (Fit  Lesson  57)* 

1.04 

1.18 

1.12 

ns 

-13.5% 

-0.13 

‘Review  tasks. 
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0.30,  which  indicates  that  almost  one-third  of  a  trial 
was  saved  in  the  Airplane  for  the  PCATD  group  for 
each  prior  trial  in  the  PCATD.  For  the  LOG  BC  task 
in  Flight  Lesson  50,  the  PCATD  group  required  1.08 
mean  trials  to  reach  criterion,  compared  with  1.47 
mean  trials  for  the  Airplane  group.  The  difference 
between  the  means  of  0,39  trials  was  significant:  t(40) 
=  2.19,  p  <  0.03  (two-tailed).  None  of  the  tasks 
reviewed  in  the  remaining  fight  lessons  indicated 
significant  transfer. 

The  means  used  to  compute  percent  transfer  and 
TERs  for  instrument  tasks  trained  in  Aviation  140  in 
the  Fall  1994  are  shown  in  Table  5.  As  in  Aviation  130 
and  the  combined  Aviation  140  data  in  Table  4,  the 
introduction  of  tasks  generally  resulted  in  better  trans¬ 
fer  than  review  of  tasks.  For  example,  non  directional 
beacon  (NDB)  holds  and  approaches  were  introduced 
in  Flight  Lesson  49.  High  positive  transfer  was  found 
for  the  mean  trials  to  proficiency  for  NDB  holds  and 
NDB  approaches  in  that  lesson.  The  percent  transfer 
was  32.5%  and  42.8%,  respectively,  and  the  TERs 
were  0.35  (NDB  holds)  and  0.40  (NDB  approach). 
Each  NDB  hold  trial  and  each  NDB  approach  trial  in 
the  PCATD  saved  over  one-third  of  a  hold  or  ap¬ 
proach  trial  in  the  airplane.  For  the  students  in  Avia¬ 
tion  140  trained  in  the  Fall  1996,  the  transfer 
effectiveness  for  both  NDB  holds  and  NDB  approaches 
for  the  PCATD  group  was  lower  in  Flight  Lesson  50 
than  for  Flight  Lesson  49,  when  NDB  holds  and 
approaches  were  introduced.  An  NDB  hold  trial  in 
the  PCATD  saved  approximately  one-tenth  of  a  trial 
in  the  airplane,  while  an  NDB  approach  trial  in  the 
PCATD  group  produced  no  savings. 

Time  to  Complete  Flight  Lesson 

The  mean  times  to  complete  the  flight  lessons  in 
Aviation  130  are  shown  in  Table  6,  together  with 
associated  values  of  percent  transfer  and  the  TERs. 
Transfer  of  training  was  substantial  for  many  lessons. 
Positive  transfer  observed  ranged  from  22.7%  transfer 
for  Flight  Lesson  38  (review  of  VOR  and  ILS  and 
introduction  of  DME  Arc)  to  37.5%  transfer  for 
Flight  Lessons  34/35  (introduction  of  steep  turns). 
Positive  TERs  ranged  from  0.23  for  Flight  Lesson  36 
(intersection  holds)  to  0.50  for  Flight  Lessons  34/35 
(introduction  to  steep  turns).  For  Flight  Lessons  34/ 


35,  the  PCATD  group  saved  one-half  hour  in  the 
airplane  for  each  prior  hour  in  the  PCATD.  For  Flight 
Lessons  34/35  (introduction  of  steep  turns),  the  mean 
time  for  the  flight  lesson  for  the  PCATD  group  was 
0.95  mean  hours  compared  with  1.52  mean  hours  for 
the  Airplane  group;  the  difference  between  the  mean 
of  0.57  hours  was  significant:  t(78)  =  5.01,  p<  0.001 
(two-tailed).  For  Flight  Lesson  37  (ILS  and  LOC  BC 
approaches),  the  percent  transfer  was  27.5  and  the 
TER  was  0.32,  which  indicated  that  the  PCATD 
group  saved  almost  one-third  of  an  hour  in  the  air¬ 
plane  for  each  prior  hour  in  the  PCATD.  For  Flight 
Lesson  37  (ILS  and  LOC  BC  approaches),  the  mean 
time  for  the  PCATD  group  to  complete  the  flight 
lesson  was  1 .74  mean  hours  compared  with  2.40  mean 
hours  for  the  Airplane  group.  The  difference  between 
the  means  of  0.68  hours  was  significant:  t(94)  =  3.32, 
p  <  0.00 1  (two-tailed).  For  Flight  Lesson  36,  intersec¬ 
tion  holds,  the  PCATD  group  saved  almost  one- 
fourth  hour  in  the  airplane  for  each  prior  hour  in  the 
PCATD.  The  PCATD  group  required  1.34  mean 
hours  to  complete  Flight  Lesson  36  (intersection 
holds),  compared  with  1.81  hours  for  the  Airplane 
group.  The  difference  between  the  means  of  0.47 
hours  was  significant:  t(99)  =  2.89,  p  <  0.001  (two- 
tailed).  For  Flight  Lesson  38  (review  of  VOR  and  ILS, 
and  Introduction  to  DME  Arc)  the  percent  transfer 
was  22.7  and  the  TER  was  0.30.  The  PCATD  group 
required  1.53  mean  hours  to  complete  this  flight 
lesson,  compared  with  1.98  mean  hours  for  the  Air¬ 
plane  group.  The  difference  between  the  means  of  0.45 
was  significant:  t(85)  =  2.82,  p  <  0.01  (two-tailed). 

The  times  to  complete  Aviation  140  flight  lessons 
for  subjects  who  had  completed  the  experimental 
curriculum  in  Aviation  130  are  shown  in  Table  7, 
together  with  the  associated  percent-transfers  and 
TERs.  Transfer  of  training,  as  measured  by  the  time  to 
complete  the  flight  lesson,  was  substantial  for  the 
introduction  of  NDB  holds  and  approaches  (Flight 
Lesson  49)  and  for  their  first  review  (Flight  Lesson 
50).  The  percent  transfer  was  26.4%  and  19.2%, 
respectively,  for  Flight  Lesson  49  and  50.  The  TERs 
were  0.22  and  0.24  respectively  for  Flight  Lesson  49 
and  50,  which  indicated  for  both  of  these  lessons  prior 
training  on  NDB  holds  and  approaches  in  the  PCATD 
saved  almost  one-fourth  of  an  hour  in  the  airplane. 
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Table  5.  Mean  trials  in  the  airplane  for  the  Airplane  only  group  (Yc)  and  the  PCATD  group  (Yx)  and 
the  mean  trials  in  the  PCATD  (X),  and  percent  transfer  and  training  effectiveness  ratios  (TERs), 
for  instrument  tasks  trained  in  Aviation  140  (Fall  1994  data). 

Percent 


Task 

Group 

Transfer 

TER 

Yc 

Yx 

X 

Holds  (Fit  Lesson  48)* 

1.69 

1.93 

2.43 

-14.2% 

-0.10 

ILS  (Fit  Lesson  48)* 

2.23 

2.00 

2.64 

10.3% 

0.09 

VOR  (Fit  Lesson  48)* 

2.31 

1.79 

1.79 

22.5% 

0.29 

NDB  Holds  (Fit  Lesson  49) 

1.69 

1.14 

1.57 

32.5% 

0.35 

NDB  Approach  (Fit  Lesson  49) 

2.62 

1.50 

2.79 

42.8% 

0.40 

NDB  Holds  (Fit  Lesson  50)* 

1.38 

1.27 

1.00 

8.0% 

0.11 

NDB  Approach  (Fit  Lesson  50)* 

1.25 

1.33 

1.08 

-6.4% 

-0.07 

LOG  BC  Holds  (Fit  Lesson  50) 

1.38 

1.31 

1.07 

5.1% 

0.07 

ILS  Holds  (Fit  Lesson  50) 

1.15 

1.08 

1.08 

6.1% 

0.06 

ILS  (Fit  Lesson  51)* 

1.00 

1.22 

1.79 

-22.0% 

-0.12 

VOR  (Fit  Lesson  51)* 

1.09 

1.08 

1.15 

0.9% 

0.01 

NDB  (Fit  Lesson  51)* 

1.50 

1.00 

2.00 

33.3% 

0.25 

ILS  (Fit  Lesson  52)* 

1.25 

1.27 

1.43 

-1.6% 

-0.01 

VOR  (Fit  Lesson  52)* 

1.17 

1.14 

1.42 

2.6% 

0.02 

NDB  (Fit  Lesson  52)* 

1.62 

1.08 

2.10 

33.3% 

0.26 

LOG  BG  (Fit  Lesson  52)* 

1.25 

1.00 

1.29 

20.0% 

0.19 

Holds  (Fit  Lesson  52)* 

1.08 

1.00 

1.50 

7.4% 

0.05 

ILS  (Fit  Lesson  53)* 

1.31 

1.21 

1.50 

7.6% 

0.07 

VOR  (Fit  Lesson  53)* 

1.10 

1.15 

1.00 

-4.6% 

-0.05 

NDB  (Fit  Lesson  53)* 

1.00 

1.14 

1.20 

-14.0% 

-0.12 

Holds  (Fit  Lesson  53)* 

1.67 

1.00 

1.33 

40.1% 

0.50 

NDB  (Fit  Lesson  54)* 

1.17 

1.29 

1.50 

-10.3% 

-0.08 

Holds  (Fit  Lesson  54)* 

1.10 

1.08 

1.00 

1 .8% 

0.02 

NDB  (Fit  Lesson  55)* 

1.75 

1.50 

1.93 

14.3% 

0.13 

Holds  (Fit  Lesson  55)* 

1.44 

1.27 

1.15 

11.8% 

0.15 

ILS  (Fit  Lesson  56)* 

1.00 

1.14 

1.07 

-14.0% 

-0.13 

VOR  (Fit  Lesson  56)* 

1.17 

1.29 

1.14 

-12.0% 

-0.11 

NDB  (Fit  Lesson  56)* 

- 

- 

1.07 

- 

“ 

Holds  (Fit  Lesson  56)* 

1.00 

1.25 

1.29 

-25.0% 

-0.19 

ILS  (Fit  Lesson  57)* 

1.00 

1.07 

1.14 

-7.0% 

-0.06 

VOR  (Fit  Lesson  57)* 

1.25 

1.29 

1.17 

-3.2% 

-0.03 

Holds  (Fit  Lesson  57)* 

1.17 

1.13 

1.22 

3.4% 

-0.03 

*Review  tasks. 
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Table  6.  Mean  time  (in  hours)  to  complete  the  fiight  lesson  for  Yc,  Yx,  and  X,  and  percent  transfer 
and  TERs  for  Aviation  130  (Combined  data  for  study).  Levels  of  statistical  significances  of 
differences  between  Yc  and  Yx  are  shown. 


Percent 

Fliaht  Lesson 

Grouo 

2 

Transfer 

TER 

Yc 

Yx 

X 

34/35  (Steep  Turns,  N=54  and  53) 

1.52 

0.95 

1.13 

<0.001 

37.5% 

0.50 

36  (Intersection  Holds,  N=54  and  53) 

1.81 

1.34 

2.07 

<0.001 

26.0% 

0.23 

37  (ILS,  LOG  BC,  N=54  and  53) 

38  (VOR,  ILS,  DME  Arc, 

2.40 

1.74 

2.05 

<0.001 

27.5% 

0.32 

N=54  and  52) 

1.98 

1.53 

1.51 

<0.01 

22.7% 

0.30 

39  (ILS,  LOG  BG,  N=52  and  52) 
40,41,43  (ILS,  LOG  BG,  VOR, 

2.12 

2.24 

1.20 

ns 

-5.7% 

-0.10 

Holds,  N=48  and  48) 

4.75 

4.72 

3.49 

ns 

0.6% 

0.01 

42  (ILS,  VOR,  Holds,  N=49  and  52) 

2.25 

2.38 

1.19 

ns 

-5.8% 

-0.11 

Table  7.  Mean  time  (in  hours)  to  complete  flight  lesson  for  Yc,  Yx,  and  X  and  percent  transfer  and 
TERs  for  Aviation  140  (After  completing  training  in  Aviation  130).  Levels  of  statistical  significances 
of  differences  between  Yc  and  Yx  are  shown. 


Percent 

Fliaht  Lesson 

Group 

B 

T  ransfer 

TER 

Yc 

Yx 

X 

49  (NDB  Holds,  Approach,  N=38 
and  39) 

50  (NDB  Holds,  Approach,  ILS 

1.63 

1.20 

1.98 

<0.001 

26.4% 

0.22 

and  LOG  BG  Holds,  N=38  and  39) 

1.88 

1.52 

1.51 

<0.04 

19.2% 

0.24 

51  (ILS,  NDB,  VOR,  N=38  and  38) 

52  (ILS,  NDB,  VOR,  LOG  BG. 

1.60 

1.58 

1.47 

ns 

1.3% 

0.01 

Holds,  N=38  and  38) 

53  (ILS,  NDB,  VOR,  Holds,  N=38 

2.05 

2.02 

1.92 

ns 

1.5% 

0.02 

and  38) 

2.13 

2.15 

1.32 

ns 

-0.9% 

-0.02 

54  (NDB,  Holds,  N=38  and  37) 

2.02 

2.02 

0.83 

ns 

0.0% 

0.00 

55  (NDB,  Holds,  N=38  and  37) 

2.47 

2.52 

1.00 

ns 

-2.0% 

-0.05 

56  (ILS,  VOR,  Holds,  N=36  and  37) 

3.94 

3.99 

1.49 

ns 

-1.3% 

-0.03 

57  (ILS,  VOR,  Holds,  N=37  and  37) 

2.14 

2.49 

1.12 

ns 

-16.4% 

-0.31 
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For  Flight  Lesson  49  (introduction  of  NDB  holds  and 
approaches),  the  PCATD  group  required  1.20  mean 
hours  to  complete  the  flight  lesson  compared  with 
1.63  mean  hours  for  the  Airplane  group.  The  differ¬ 
ence  between  the  means  was  significant:  t(57)  =  2.96, 
p  <  0.001  (two-tailed).  NDB  holds  and  approaches, 
ILS  and  LOG  BC  holds  were  reviewed  in  Flight 
Lesson  50.  The  mean  time  to  complete  the  flight 
lesson  for  the  PCATD  group  was  1.52  mean  hours 
compared  with  1.88  mean  hours  for  the  Airplane 
group.  The  difference  between  the  means  of  0.36 
hours  was  significant:  t(65)  =  2.06,  p  <  0.04  (two- 
tailed).  There  was  no  significant  transfer,  as  measured 
by  time,  for  the  remaining  flight  lessons.  The  percent 
transfer  was  -16.4%,  and  the  TER  was  -0.31  which 
means  that  for  each  hour  in  the  PCATD  it  took  the 
PCATD  group  almost  one-third  of  an  hour  longer  to 
complete  the  lesson  in  the  airplane  than  the  Airplane 
group.  This  difference  was  not  significant. 

The  mean  times  to  complete  selected  flight  lessons 
in  Aviation  140  are  shown  for  the  Fall  1994  data  in 
Table  8,  together  with  associated  values  of  percent 
transfer  and  the  TERs.  As  indicated  in  Table  8,  for 
Flight  Lesson  49  (the  introduction  of  NDB  holds  and 


approaches)  and  for  their  review  (Flight  Lesson  50), 
the  transfer  effectiveness  for  the  time  to  complete  the 
flight  lesson  variable  was  positive  and  substantial. 
Transfer  for  Flight  Lesson  49  was  31.6%  and  23.2% 
for  Flight  Lesson  50.  TERs  for  lessons  49  and  50  were 
0.31  and  0.35,  respectively.  PCATD  students  saved 
about  a  third  of  an  hour  in  the  airplane  for  each  hour 
in  the  PCATD. 

Course  Completion  Time 

The  means  and  variances  for  total  airplane  time  for 
the  Airplane  and  the  PCATD  groups  to  complete  the 
two  courses  are  shown  in  Table  9.  For  Aviation  130, 
the  PCATD  group  required  a  mean  of  21.0  hours  to 
complete  the  course,  compared  with  23.1  hours  for 
the  Airplane  group.  The  difference  between  the  means 
of  2.1  hours  was  significant:  t(90)  =  3.53,  p  <  0.001 
(two  tailed).  The  data  for  those  Aviation  140  subjects 
who  first  completed  the  Aviation  130  experimental 
program  indicated  that  the  PCATD  group  required  a 
mean  of  26.37  hours  to  complete  the  course,  com¬ 
pared  with  28.18  hours  for  the  Airplane  group.  The 
difference  between  the  means  of  1.81  hours  was  sig¬ 
nificant:  t(72)  =  2.6 1,  p  <  0.01  (two  tailed). 


Table  8.  Mean  time  (in  hours)  to  complete  flight  lesson  for  Yc,  Yx,  and  X,  and  percent  transfer  and 
TERs  for  Aviation  140  (Fall  1994  Data). 


Flight  Lesson 


49  (NDB  Holds,  Approaches,  N=13 
and  1 4) 

50  (NDB  Holds,  Approaches,  ILS 
and  LOG  BC,  N=13and14) 

51  (ILS,  NDB,  VOR,  N=13  and  14) 

52  (ILS,  NDB,  VOR,  LOG  BC, 
Holds,  N=13and  14) 

53  (ILS,  NDB,  VOR,  Holds,  N=13 
and  1 4) 

54  (NDB,  Holds,  N=12  and  14) 

55  (NDB,  Holds,  N=13  and  14) 

56  (ILS,  VOR,  Holds,  N=12  and  14) 

57  (ILS,  VOR,  Holds,  N=12  and  14) 


Percent 


Group 

Transfer 

TER 

Yc 

Yx 

X 

1.90 

1.30 

1.92 

31.6% 

0.31 

1.81 

1.39 

1.19 

23.2% 

0.35 

1.54 

1.61 

2.20 

-7.0% 

-0.03 

2.52 

1.73 

1.96 

31.4% 

0.40 

2.18 

2.08 

1.06 

4.6% 

0.09 

1.99 

1.85 

0.87 

7.0% 

0.07 

2.74 

2.50 

1.05 

8.8% 

0.23 

4.02 

4.15 

1.07 

-3.2% 

-0.12 

2.13 

2.16 

1.02 

-1.4% 

-0.03 
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Table  9.  Mean  Airplane  times  (in  hours)  and  variances  to  complete  courses  for  Airplane  and 
PCATD  groups  for  Aviation  130  and  Aviation  140. 


Mean 

(Yc-Yx) 

Variance 

N 

t 

S 

Aviation  130 
(Yc)  Airplane 

23.1 

8.3 

45 

(Yx)  PCATD 

21.0 

2.1 

8.3 

47 

3.5 

<  0.001 

Aviation  140 

Airplane 

28.2 

8.41 

36 

PCATD 

26.4 

1.8 

9.47 

38 

2.61 

<0.01 

Aviation  140  (Fall  1994) 

Airplane 

29.8 

9.85 

13 

PCATD 

26.7 

3.1 

5.67 

14 

2.91 

<0.05 

For  the  Aviation  140  Fall  1994  data,  the  PCATD 
group  required  a  mean  of  26.7  hours  to  complete  the 
course,  compared  with  29.8  hours  for  the  Airplane 
group.  The  difference  between  the  means  of  3. 1  hours 
was  significant:  t(25)  =  2.91,  p  <  0.05  (two  tailed). 

DISCUSSION 

The  data  from  the  study  indicate  that  the  PCATD 
is  an  effective  training  device  for  teaching  instrument 
tasks  to  private  pilots.  These  data  show  a  significant 
level  of  transfer  savings  for  course  hours  overall. 
Approximately  4.0  hours  were  saved  for  Aviation  1 30 
and  Aviation  140  combined.  This  represents  a  worth¬ 
while  benefit  because  rental  costs  are  $69/hour  for  the 
airplane  used  in  this  experiment  and  $5/hour  for  the 
PCATD.  The  savings  may  seem  marginal  in  light  of 
the  fact  that  time  spent  in  the  PCATD  to  generate 
those  savings  exceeded  12.5  hours  for  Aviation  130 
and  14  hours  for  Aviation  140.  It  should  be  noted, 
however,  that  the  procedures  developed  to  satisfy  the 
goal  of  the  experiment  generated  inefficiencies.  In 
that  the  primary  goal  was  to  explore  all  possibilities  of 
contributions  of  the  PCATD,  a  considerable  amount 
of  the  PCATD  training  was  undertaken  to  review  task 
areas  that  resulted  in  little  or  no  transfer.  Training 
PCATD  flight  lessons  to  proficiency  also  reduced  the 
efficient  use  of  the  PCATD. 


Some  signs  of  negative  transfer  are  also  evident. 
None  of  these  effects  was  statistically  significant,  and 
they  probably  reflect  random  fluctuations.  The  data 
that  have  been  generated  in  this  experiment  offer  a 
solid  guide  to  development  of  an  instrument  syllabus 
that  could  maximize  the  efficiency  of  the  PCATD. 
Indeed,  further  savings  should  be  possible  from  tar¬ 
geting  for  PCATD  training  only  those  tasks  that  show 
worthwhile  positive  transfer.  Specifically,  the  data 
suggest  that  the  same  savings  of  approximately  four 
hours  could  be  achieved  by  use  of  approximately  6.75 
PCATD  hours  in  Flight  Lessons  34  to  38  and  4.5 
PCATD  hours  in  Flight  Lessons  45  to  50. 

Aviation  130 

Flight  Lessons  34  to  38  were  used  to  develop 
proficiency  in  a  number  of  basic  instrument  tasks  and 
to  introduce  and  review  various  instrument  hold  and 
approach  procedures.  Total  lesson  times  for  each  of 
these  lessons  showed  significant  levels  of  transfer 
ranging  from  approximately  20  to  40%,  with  TERs 
ranging  from  approximately  0.20  to  0.50.  Analyses  of 
individual  tasks  revealed  that,  in  almost  all  cases,  this 
transfer  resulted,  at  least  in  part,  from  the  learning  of 
specific  instrument  maneuvers  when  they  were  first 
introduced. 


15 


The  single  exception  to  this  trend  was  in  Flight 
Lessons  34  and  35,  when  the  task  of  steep  turns  failed 
to  reveal  significant  transfer,  but  there  was  significant 
transfer  for  the  overall  flight  lesson.  In  that  Flight 
Lessons  34  and  35  included  a  considerable  amount  of 
nonspecific  flying  beyond  steep  turns  that  were  also 
practiced  in  the  PCATD,  we  assume  the  enhancement 
was  generated  in  these  nonspecific  flying  activities. 
No  single  instrument  procedure  trained  in  Aviation 
130  showed  statistically  significant  transfer  in  any 
lesson  in  which  it  was  reviewed.  A  few  of  the  transfer 
indexes  for  reviews  of  instrument  procedures  were 
negative,  but  none  approached  statistical  significance. 

Flight  Lessons  39  to  42  prepared  students  for 
Instrument  Flight  Rules  (IFR)  cross-country  flight.  It 
was  difficult  to  develop  a  PCATD  scenario  that  would 
assist  the  students  with  very  much  of  this  preparation. 
The  exercise  that  was  developed  had  students  practice 
ILS,  VOR,  and  LOG  BC  that  would  be  flown  in  the 
cross-country  flight,  which  provided  an  opportunity 
to  rehearse  these  tasks  in  the  PCATD  prior  to  the 
cross-country  flight.  The  percent  transfer  and  TER 
were  insensitive  measures  in  terms  of  determining  the 
potential  benefit  of  approach  rehearsal  during  those 
flight  lessons.  The  specific  objectives  of  the  flight 
lessons  prevented  substantial  transfer,  as  measured  by 
the  percent  transfer  and  TER. 

Flight  Lesson  43  was  a  review  of  IFR  procedures 
and  cross-country  skills  with  the  completion  stan¬ 
dards  to  the  Instrument  Rating  Practical  Test  Stan¬ 
dards  for  the  lesson  content  with  no  assistance  from 
the  instructor.  It  was  required  that  the  PCATD  group 
fly  the  PCATD  a  minimum  of  one  hour  per  lesson  in 
Flight  Lessons  40  and  41.  The  group  could  use  the 
PCATD  up  to  a  maximum  of  five  hours  in  Flight 
Lessons  40-43  combined.  Additional  PCATD  time 
was  available  with  prior  permission.  Since  the  means 
of  airplane  trials  to  completion  standards  show  that 
most  students  required  only  one  trial  to  achieve  pro¬ 
ficiency  on  each  of  these  exercises,  high  levels  of 
positive  transfer  were  not  expected.  One  approach  trial 
would  be  expected  in  cross-country  flight,  since  the 
students  would  typically  perform  only  one  ILS,  VOR, 
and/or  LOC  BC  approach  in  the  airplane  at  any  airport. 


The  final  two  lessons  in  Aviation  130  are  devoted 
to  a  practice  check  flight  and  a  check  flight.  These 
lessons  may  appear  at  first  to  offer  a  critical  point  for 
measuring  training  effectiveness.  However,  it  was 
assumed  at  the  outset  that  these  measures  would  be 
insensitive  to  differences  between  the  Airplane  and 
the  PCATD  groups.  By  design  of  the  experiment, 
students  from  both  groups  had  been  brought  to  the 
same  proficiency  standards  lesson  by  lesson  in  the 
airplane.  The  only  possibility  that  real  differences 
would  show  up  in  the  practice  or  the  real  check  flight 
is  that  one  or  the  other  of  the  training  conditions  had 
provided  some  sort  of  learning  experience  that  con¬ 
tributed  substantially  to  overall  flight  competence,  as 
evaluated  in  the  check  flight,  but  had  not  been  taught 
explicitly.  There  is  no  evidence  here  that  this  occurred. 

Aviation  140 

As  noted  earlier.  Aviation  140  students  were  not 
treated  identically  in  this  experiment.  The  first  group 
of  Aviation  140  subjects  (Fall  1994)  had  not  been 
involved  in  the  experiment  during  their  Aviation  1 30 
training.  The  remaining  Aviation  140  subjects  had 
been  in  the  experiment  as  Aviation  130  subjects  prior 
to  taking  the  experimental  curriculum  in  Aviation 
140.  Their  data  are  combined  into  a  single  data  set  and 
treated  separately  from  the  Aviation  140  data  col¬ 
lected  during  in  the  Fall  1994.  Some  differences 
between  the  two  sets  of  results  are  evident.  Most 
noticeably,  there  was  a  difference  in  transfer,  based  on 
time  required  to  complete  Flight  Lesson  52,  for  trans¬ 
fer  based  on  trials  to  reach  criterion  for  review  of  NDB 
and  LOC  BC  approaches  in  Flight  Lesson  52,  and  for 
transfer  based  on  trials  to  reach  criterion  for  review  of 
holds  in  Flight  Lesson  53.  There  are  a  number  of 
possible  reasons  for  changes  of  this  type  from  semester 
to  semester,  two  being  variations  in  weather  and  a 
changing  pool  of  instructors.  The  most  likely  explana¬ 
tion  is  that  the  small  number  of  students  in  the  Fall 
1994,  coupled  with  the  fact  that  these  review  lessons 
required  very  few  trials  to  criterion  in  the  airplane, 
induced  some  instability  in  the  data.  Because  of  the 
limited  resources  available  for  this  project,  we  could 
not  investigate  the  cause  of  these  differences.  Given 
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the  possibility  of  unstable  data  for  the  Fall  1 994  group 
of  Aviation  140  students,  we  emphasize  the  Aviation 
140  combined  data  set  in  this  discussion. 

As  in  Aviation  130,  task  introduction  generally 
resulted  in  better  transfer  than  task  review  but  several 
exceptions  were  observed.  Flight  Lesson  48  was  a 
review  lesson  for  the  ILS  and  VOR  approaches.  The 
subjects  had  received  substantial  practice  on  these 
tasks  in  Aviation  130  during  the  previous  semester. 
The  data  indicate  that,  compared  with  the  Airplane 
group,  the  PCATD  group  saved  in  the  airplane  ap¬ 
proximately  one-fifth  of  the  trials  on  the  VOR  ap¬ 
proaches,  due  to  prior  review  in  the  PCATD.  This  is 
strong  evidence  that  the  PCATD  is  an  effective  tool 
for  reviewing  previously  learned  instrument  tasks  if 
some  time  has  elapsed  since  the  tasks  were  last  prac¬ 
ticed,  Indeed,  these  data  are  in  marked  contrast  to  the 
review  data  obtained  in  Aviation  130  that  indicated 
review  of  instrument  tasks  learned  to  proficiency 
during  the  previous  lesson  was  not  a  productive  use  of 
the  PCATD. 

In  other  respects,  the  observations  to  be  drawn  on 
the  data  from  the  Aviation  140  closely  follow  those 
drawn  on  the  data  from  Aviation  130.  Again,  it  was 
the  early  lessons  in  which  new  material  was  intro¬ 
duced  that  there  was  significant  positive  transfer. 
Flight  Lessons  49  and  50  showed  transfer  values  of 
approximately  20  and  25%,  with  TERs  of  approxi¬ 
mately  0.20  and  0.25.  All  tasks  in  these  two  lessons 
were  introduced  here  for  the  first  time;  all,  with  the 
exception  of  NDB  holds  in  Flight  Lesson  49  and  ILS 
holds  in  Flight  Lesson  50,  showed  statistically  signifi¬ 
cant  positive  transfer.  These  values  ranged  from  ap¬ 
proximately  15  to  30%,  with  TERs  in  the  range  of 
approximately  0.15  to  0.40.  With  the  exception  of 
VOR  in  Flight  Lesson  48  and  NDB  holds  and  ap¬ 
proaches  in  Flight  Lesson  50,  no  reviewed  tasks  showed 
statistically  significant  positive  transfer,  and  none  of 
the  negative  transfer  values  was  statistically  signifi¬ 
cant.  No  times  to  complete  the  flight  lessons  in 
Aviation  140  showed  statistically  significant  positive 
transfer,  with  the  exception  of  Flight  Lessons  49  and  50. 

As  in  Aviation  130,  the  practice  checkflight  for 
Aviation  140  (Flight  Lesson  58)  and  the  checkflight 
(Flight  Lesson  60)  may  appear  at  first  to  offer  a  critical 
point  for  measurement  of  training  effectiveness.  How¬ 


ever,  these  two  lessons  were  again  unlikely  to  discrimi¬ 
nate  between  the  training  conditions  because  in  pre¬ 
ceding  lessons,  instructors  were  required  to  bring 
students  from  both  groups  to  the  same  standards  of 
proficiency.  Flight  Lesson  59  was  used  to  review 
instrument  procedures  for  which  individual  students 
had  not  met  instrument  rating  practical  test  stan¬ 
dards.  There  were  relatively  few  students  providing 
data  on  any  specific  exercise.  It  is  likely  that  instruc¬ 
tors  used  this  lesson  to  selectively  reinforce  a  student's 
weakest  areas.  Some  of  the  transfer  ratios  in  this  lesson 
are  high  and  there  is  also  one  large  negative  value. 
Nevertheless,  these  ratios  are  difficult  to  interpret 
because  of  the  selective  nature  of  the  data. 

Substitution  of  the  PCATD  for  Instrument 
Flight  Hours 

Current  FAA  regulations,  FAR  Part  141.41,  permit 
the  substitution  of  15  hours  of  time  in  a  certified 
ground  trainer  for  aircraft  time  required  for  instru¬ 
ment  certification  (FAA,  1992).  The  FAA  Flight  Stan¬ 
dards  Office  has  drafted  an  Advisory  Circular,  which 
provides  that  some  of  those  hours  of  the  instrument 
time  required  by  FAR  Part  14 1  can  be  flown  in  a 
PCATD.  The  draft  advisory  circular,  if  approved, 
would  permit  a  PCATD,  that  meets  the  requirements 
of  FAR  Part  141.41  (a)  (1),  to  be  used  in  lieu  of  some 
of  the  time  afforded  an  authorized  ground  training 
device  under  FAR  Part  141,  Appendix  C.  As  men¬ 
tioned  earlier,  the  PCATD  group  required  a  mean 
47.4  hours  in  the  airplane  to  complete  the  instrument 
rating,  compared  with  51.3  hours  for  the  Airplane 
group.  This  represents  a  saving  of  approximately  4 
hours.  This  finding  supports  the  proposal  to  permit 
the  substitution  of  PCATD  time  for  instrument  time. 
Indeed,  the  data  presented  here  suggest  that  the 
PCATD  is  effective  in  teaching  all  instrument  tasks. 

This  experiment  is  specific  to  evaluation  of  a 
PCATD.  It  is  possible  that  a  generic  training  device 
would  be  more  effective  and  might  not  suffer  from  the 
occasional  problems  of  negative  transfer  we  have  ob¬ 
served  here.  However,  the  available  evidence  does  not 
support  this  belief  (Hampton  et  al.,  1994)  and  there 
is  little  evidence  that  a  generic  training  device  would 
offer  any  benefit  in  addition  to  that  gained  from  the 
PCATD. 


17 


SUMMARY 

The  data  show  that  training  in  a  PCATD  resulted 
in  positive  transfer  for  instrument  flight  tasks  when 
measured  in  reference  to  trials  to  criterion  or  time  to 
complete  a  flight  lesson  in  the  airplane.  The  benefit  of 
training  in  the  PCATD  varied  substantially  among 
the  instrument  tasks  tested  (from  15%  to  over  40%). 
In  general,  savings  were  positive  and  substantial  when 
new  tasks  were  introduced.  The  data  indicated  that  a 
PCATD  can  save  a  part  of  the  aircraft  time  that  would 
otherwise  be  needed.  A  comparison  of  course  comple¬ 
tion  times  for  the  two  courses  resulted  in  savings  of 
about  four  hours  for  the  PCATD  group,  compared 
with  the  Airplane  group. 

Time  constraints  and  other  organizational  limita¬ 
tions  prevented  the  full  use  of  the  PCATD  in  all  flight 
lessons.  One  substantial  constraint  on  savings  is  an 
FAA-mandated  requirement  of  four  hours  of  pilot-in¬ 
command  cross-country  time  in  Aviation  130  and 
12.5  hours  in  Aviation  140.  In  the  present  experi¬ 
ment,  the  PCATD  was  not  used  to  teach  cross-coun¬ 
try  skills.  It  would,  however,  be  possible  to  offer 
practice  on  cross-country  scenarios.  With  develop¬ 
ment  of  an  appropriate  assessment  tool,  it  may  be 
possible  to  demonstrate  that  PCATD-trained  stu¬ 
dents  could  achieve  full  competence  with  cross-coun¬ 
try  flight  well  before  they  had  completed  their 
mandated  exercises.  Adjustments  in  the  way  the 
PCATD  has  been  used  may  extend  its  usefulness  in 
relation  to  these  tasks. 

The  data  also  reveal  that  some  tasks  do  not  benefit 
to  a  large  extent  from  training  in  the  PCATD,  and 
that  use  of  the  PCATD  is  more  beneficial  for  training 
of  new  tasks  than  it  is  for  review  of  tasks  trained  earlier 
in  the  course.  These  results  suggest  principles  that 
might  be  used  to  target  a  PCATD  for  maximum 
effectiveness  within  a  flight  training  program.  This 
was  not  done  in  the  present  study.  Our  objective  was 
to  investigate  the  instrument  tasks  that  could  be 
trained  using  a  PCATD.  In  that  the  overall  savings  in 
each  of  the  courses,  although  statistically  significant, 
are  relatively  small,  it  may  be  desirable  to  ensure  that 
a  PCATD  is  focused  specifically  on  areas  that  result  in 
substantial  transfer  to  the  airplane. 
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